Skip to content

[codex] Restore terminal coverage env test state after #1917 - #1918

Merged
stranske merged 2 commits into
mainfrom
codex/workflows-contract-hardening-104
Apr 26, 2026
Merged

[codex] Restore terminal coverage env test state after #1917#1918
stranske merged 2 commits into
mainfrom
codex/workflows-contract-hardening-104

Conversation

@stranske

@stranske stranske commented Apr 26, 2026

Copy link
Copy Markdown
Owner

Source: Issue #1836

Related to campaign issue #1836

Summary

  • follow up on Copilot review feedback from [codex] Harden weekly telemetry contracts #1917
  • restore both unsupported-model env vars after the terminal coverage env-alias test
  • prevent environment leakage between Node tests when the suite runs with caller-provided env vars
  • lock aggregate metrics parse-error overflow attribution to the stable sentinel bucket

Verification

  • node --test .github/scripts/tests/terminal-disposition-coverage.test.js
  • python -m pytest tests/scripts/test_aggregate_agent_metrics.py -q
  • python -m ruff check tests/scripts/test_aggregate_agent_metrics.py
  • python -m black --check --line-length 100 --target-version py312 tests/scripts/test_aggregate_agent_metrics.py
  • git diff --check

Automated Status Summary

Scope

Sync/Dependabot Campaign Queue

Remote GitHub Actions owns discovery for sync-generated and Dependabot PR rounds. Local Codex should only claim items from this issue when needs-local-codex work is queued.

Summary

Context for Agent

Related Issues/PRs

Tasks

  • Updated: 2026-04-26T20:14:45.242Z
  • Repos checked: 11/11
  • Open sync PRs: 593
  • Open Dependabot PRs: 0
  • Active review threads queued: 1176
  • Items needing local Codex: 0
  • Actionable local Codex items: 0
  • Claimable local Codex items: 0
  • Source-fixed candidates: 1
  • Superseded sync candidates: 119
  • Finished local results without published source changes: 0
  • Claimed local Codex items: 0
  • Next claim lease expires: -

Acceptance criteria

Head SHA: 63160cf
Latest Runs: ✅ success — Gate
Required: gate: ✅ success

Workflow / Job Result Logs
Gate ✅ success View run
Health 40 Sweep ✅ success View run
Health 44 Gate Branch Protection ✅ success View run
Health 45 Agents Guard ✅ success View run
Health 50 Security Scan ✅ success View run
Health 72 Template Sync ✅ success View run
Maint 52 Validate Workflows ✅ success View run
PR 11 - Minimal invariant CI ✅ success View run
Selftest CI ✅ success View run
Validate Sync Manifest ✅ success View run

Copilot AI review requested due to automatic review settings April 26, 2026 21:07
@stranske-keepalive

stranske-keepalive Bot commented Apr 26, 2026

Copy link
Copy Markdown
Contributor

Automated Status Summary

Head SHA: f90dd45
Latest Runs: ⏳ pending — Gate
Required contexts: Gate / gate, Health 45 Agents Guard / guard
Required: core tests (3.12): ⏳ pending, core tests (3.13): ⏳ pending, docker smoke: ⏳ pending, gate: ⏳ pending

Workflow / Job Result Logs
(no jobs reported) ⏳ pending

Coverage Overview

  • Coverage history entries: 1

Coverage Trend

Metric Value
Current 93.12%
Baseline 85.00%
Delta +8.12%
Minimum 70.00%
Status ✅ Pass

Top Coverage Hotspots (lowest coverage)

File Coverage Missing
src/cli_parser.py 81.8% 4
src/percentile_calculator.py 95.0% 1
src/aggregator.py 95.0% 2
src/__init__.py 100.0% 0
src/ndjson_parser.py 100.0% 0

Updated automatically; will refresh on subsequent CI/Docker completions.


Keepalive checklist

Scope

No scope information available

Tasks

  • No tasks defined

Acceptance criteria

  • No acceptance criteria defined

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR follows up on #1917 by hardening test isolation around environment variables used for terminal disposition coverage, preventing cross-test leakage when Node tests run under caller-provided env vars.

Changes:

  • Restore both UNSUPPORTED_VERIFIER_MODELS and TERMINAL_DISPOSITION_UNSUPPORTED_CODEX_MODELS after the env-alias coverage test in the Node test suite.
  • Add a Python unit test ensuring parse-error overflow compaction does not preserve the incoming detail’s identity fields.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.

File Description
tests/scripts/test_aggregate_agent_metrics.py Adds regression test for parse-error overflow behavior and contract aggregation.
.github/scripts/__tests__/terminal-disposition-coverage.test.js Prevents env var leakage by snapshotting and restoring relevant env vars in finally.

@stranske
stranske merged commit 92c6050 into main Apr 26, 2026
76 of 78 checks passed
@stranske
stranske deleted the codex/workflows-contract-hardening-104 branch April 26, 2026 21:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants